
Internat 



Journal of 



o 



ISSN 1568-4156 

Integrated Care 



Volume 14, 16 June 2014 
Publisher: Igitur publishing 
URL:http://www.ijic.org 

Cite this a s: Int J Integr Ca re 2014; Apr-Jun; URN:NBN:NL:UI:10-1-114783 
Copyright: | (cc)EM 

Submitted: 19 December 2013, revised 13 May 2014, accepted 14 May 2014 



Lost and Found 

Adapting the Quebecois method for assessing implementation 
to the French National Alzheimer Plan 2008-2012: lessons for 
gerontological services integration 

Dominique Somme, Professor of Medicine, Head of the Department of Geriatrics, Universite de Rennes 1, Rennes, 
France, and Center for Research on Political Action in Europe (UMR 6051, CNRS), Universite Rennes 1, Rennes, 
France 

Helene Trouve, Fondation Nationale de Gerontologie, Paris, France 

Catherine Perisset, Caisse Nationale de Solidarity pour I'Autonomie, Paris, France 

Aline Corvol, CHU de Rennes, Rennes, France 

Joel Ankri, Professor of Medicine, Head of the Department of Geriatrics, Universite de Versailles-Saint-Quentin, 
Laboratoire Sante Environnement Vieillissement, EA 2506, Centre de Gerontologie, Paris, France 

Olivier Saint-Jean, Professor of Medicine, Head of the Department of Geriatrics, Universite Paris-Descartes, Paris, 
France 

Matthieu de Stampa, Universite de Versailles-Saint-Quentin, Laboratoire Sante Environnement Vieillissement, EA 
2506, Centre de Gerontologie, Paris, France 

Correspondence to: Dominique Somme, CHU de Rennes, La Tauvrais, rue de La Tauvrais, 35033 Rennes Cedex 9, France. 
Telephone: +33 2 99 28 42 56; Fax +33 2 99 28 41 63; E-mail: dominique.somme@chu-rennes.fr 



Abstract 

Introduction: Many countries face ageing-related demographic and epidemiological challenges, notably neurodegenerative disorders, 
due to the multiple care services they require, thereby pleading for a more integrated system of care. The integrated Quebecois method 
issued from the Programme of Research to Integrate Services for the Maintenance of Autonomy inspired a French pilot experiment and 
the National Alzheimer Plan 2008-2012. Programme of Research to Integrate Services for the Maintenance of Autonomy method imple- 
mentation was rated with an evaluation grid adapted to assess its successive degrees of completion. 

Discussion: The approaching end of the president's term led to the method's institutionalization (201 1-2012), before the implementation 
study ended. When the government changed, the study was interrupted. The results extracted from that 'lost' study (presented herein) have, 
nonetheless, 'found' some key lessons. 

Key lessons/conclusion: It was possible to implement a Quebecois integrated-care method in France. We describe the lessons and 
pitfalls encountered in adapting this evaluation tool. This process is necessarily multidisciplinary and requires a test phase. A simple 
tool for quantitative assessment of integration was obtained. The first assessment of the tool was unsatisfactory but requires further studies. 
In the meantime, we recommend using mixed methodologies to assess the services integration level. 
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Introduction 

Services integration is often cited as a way to adapt 
heath care systems to the changing demographic and 
epidemiological stakes [1,2]. However, the methods 
enabling implementation of new organizations are 
rarely spelled-out clearly. Moreover, the need to follow 
integration-implementation progression is considered 
one of the major challenges in this research field [3]. 
The Quebecois Programme of Research to Integrate 
Services for the Maintenance of Autonomy method 
experiments, followed by their becoming public policy 
there and then in France, provided the opportunity to 
evaluate the degree of implementation. Herein, we 
describe the lessons learned concerning assessment 
of the degree of implementation, from the comparison 
of the Programme of Research to Integrate Services 
for the Maintenance of Autonomy method quantitative 
and qualitative data. That study was prematurely inter- 
rupted when the institutionalization phase began 
because of political pressure as the president's term 
ended, hence the results presented herein must be 
confirmed in other contexts. 

Context: experiments based on 
the Programme of Research to 
Integrate Services for the 
Maintenance of Autonomy 
integration method 

Programme of Research to Integrate 
Services for the Maintenance of 
Autonomy method: definition and origin 

The Programme of Research to Integrate Services for 
the Maintenance of Autonomy method is based on 
this definition of integration. 'We consider integrated 
care to be a discrete set of techniques and organiza- 
tional methods designed to create connectivity, align- 
ment and collaboration within and between the cure 
and care sectors at the funding, administrative and/or 
provider levels. The goals are to enhance quality of 
care and quality of life, consumer satisfaction, and sys- 
tem efficiency [4]'. More precisely, this method seeks to 
instigate system change via the approach Leutz desig- 
nated 'coordination' [5,6]. Starting with the study of 
these definitions and concepts, and the systematic 
analysis of the literature, the Programme of Research 



to Integrate Services for the Maintenance of Autonomy 
method is based on six elements: inter-organization 
and inter-facility coordination, a single entry point, 
case-management system, a sole evaluation tool 
coupled to a classification-of-needs system, use of an 
individualized-services plan and an information-sharing 
system with a shared electronic clinical chart [5]. Mod- 
elized in Quebec [5], tested between 2000 and 2005, 
and evaluated positively [7], Programme of Research 
to Integrate Services for the Maintenance of Autonomy 
inspired the 2004 reform of that national health care 
system [7]. 

First application of the method outside 
its country of origin: Programme of 
Research to Integrate Services for the 
Maintenance of Autonomy-France 

Experimental phase 

The Programme of Research to Integrate Senices for the Maintenance 
of Autonomy-France experiment 

Based on the promising Quebecois Programme of 
Research to Integrate Services for the Maintenance of 
Autonomy experimentation results, French authorities 
funded the Programme of Research to Integrate Ser- 
vices for the Maintenance of Autonomy-France project 
(2006-2010), aiming to reproduce the method in 
France and testing its appropriateness for this different 
context [8,9]. Three geographic areas differing in their 
populations and accesses to care were selected for 
this experiment. All stakeholders involved in keeping 
the elderly in their own homes were invited to partici- 
pate in this integration experiment directed by a Steer- 
ing Committee in close contact with the scientific team. 
The organizational modifications required to initiate the 
Programme of Research to Integrate Services for the 
Maintenance of Autonomy method were identified, and 
the Steering Committee followed and facilitated their 
operationalization. The experiment's midterm outcome 
was promising but still required a major integrative effort 
[10-12]. Measuring impact was not foreseen. However, 
the programme assured that the services organizations 
created were truly innovative and changed professional 
practices [13], and that this experiment could make 
sense for the most vulnerable users [12]. 

Home for Autonomy and Integration of Alzheimer patients experiments 

Based on the first Programme of Research to Integrate 
Services for the Maintenance of Autonomy-France 
experiment, public authorities decided, in 2008, to 
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repeat the experiment on a larger scale, within the fra- 
mework of the National Alzheimer Plan 2008-2012, 
and called it Home for Autonomy and Integration of 
Alzheimer patients (MAIA) [8]. Among the plans' 
44 objectives, 10 were considered core aims, one of 
which was to develop integrated care, based on the 
Programme of Research to Integrate Services for the 
Maintenance of Autonomy method renamed Home for 
Autonomy and Integration of Alzheimer patients [14]. 

Unfortunately, that name is doubly misleading as no 
facility construction ('homes') was involved; only the 
six Programme of Research to Integrate Services for 
the Maintenance of Autonomy method axes were 
established. Moreover, the method was not reserved 
for Alzheimer's patients, merely considered a 'typical 
case' of system fragmentation, but that the Programme 
of Research to Integrate Services for the Maintenance 
of Autonomy method should be tried for Alzheimer's 
patients and subsequently be 'expanded' to all people 
with loss of autonomy. The experiment covered 17 geo- 
graphic areas with very diverse sizes and population 
densities, and was conducted jointly by a national 
Steering Committee and a local director in each zone 
called the 'local pilot' [8]. The pilot in one area did not 
provide the requested indicators. However, the remain- 
ing 16 selected zones were home to 4,720,775 inhabi- 
tants, among which 982,779 were aged 60 years and 
over and 65,051 were eligible for financial assistance 
to pay for services to compensate for the loss of func- 
tional autonomy. In those areas, based on an extrapo- 
lation of prevalence calculated from reimbursement 
claims made to the National Health Insurance, an esti- 
mated 79,211-103,221 people had Alzheimer's dis- 
ease. The integrated method's target population was 
all persons with loss of autonomy, particularly those 
with Alzheimer's disease. Additional 'characteristics' 
were not required for inclusion in that very large target 
population. However, case management was intended 
to benefit only a very small subpopulation included in 
the programme whose 'home-care situation' was com- 
plex, but the latter was not explicitly defined, and relied 
rather on the judgments of implicated professionals and 
case managers. Hence, approximately 40 individuals 
were selected for case management per manager 
(two case managers/site). All the health-and-social ser- 
vices (geriatric unit, geriatric day hospital, at-home hos- 
pitalization, long-term nursing services, professional 
and non-professional aides for personal autonomy, 
household services, etc.) required for community- 
dwelling elderly in the selected areas were concerned. 

The 2008-2010 experiment was considered sufficiently 
satisfactory to undertake a progressive nationwide pol- 
icy-extension process: adding 40 new geographic 
areas in 2011, 100 in 2012 and 50 in 2013. 



Innovations: methods for 
evaluating the degree of 
integration implementation 

Here, we successively describe a grid developed in 
Quebec for research to measure integration and its 
conceptual framework, its adaptation to the French 
research setting and, finally, two tools (one long and 
one very short), with the latter developed for change- 
management purposes. 

The Quebecois Programme of Research 
to Integrate Services for the 
Maintenance of Autonomy experimental 
phase 

A grid constructed to monitor method implementation 
relied on data from focus groups, composed of research- 
ers, clinicians, facility administrators and government offi- 
cials. The conceptual framework is the definition of 
integrated care (see above) and the six above-mentioned 
elements: inter-organization and inter-facility coordina- 
tion, single entry point, case-management, a sole evalua- 
tion tool, use of an individualized-services plan and an 
information-sharing system [5]. This tool was developed 
to identify pertinent implementation-monitoring markers 
for each of the six system axes and establish their relative 
weighting, using precise indicators able to assess the 
implementation level for each of them. Variable weighting 
enables subsequent calculation of the final implemen- 
tation rate. The implementation level, evaluated over 
30 months by the research team, was reported to all the 
participants and discussed to consensus at roundtable 
meetings [15]. Stakeholders considered those reports to 
be a factor of the experiment's success [16]. The grid 
was complex and required the collection of quantitative 
(e.g. extraction of information from the case manager's 
files) and qualitative data (e.g. derived from participatory 
observation or the coordination-meeting report). This 
assessment method was doubly 'validated': as a func- 
tion of its implementation stage, an integration-induced 
change could be determined ('dose-response' effect) 
and, for integration to produce its positive effects, 
i.e. preventing loss of autonomy (primary endpoint), 
the evaluation had to reach 70% implementation in 
Quebec ('threshold' effect) [7]. In 2005, based on those 
findings and inspired by the Programme of Research to 
Integrate Services for the Maintenance of Autonomy 
method, public authorities initiated an integration policy 
at the province level, through the Network of Integrated 
Services for the Elderly. During the latter's establish- 
ment, a simplified assessment tool (not shown here), 
using items considered in the Programme of Research 
to Integrate Services for the Maintenance of Autonomy 
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method, was used. The Netword of Integrated Services 
for the Elderly-implantation monitoring tool was given to 
agencies for an obligatory annual self-evaluation [17]. 

During the Programme of Research to 
Integrate Services for the Maintenance 
of Autonomy- France experimental 
phase 

The Quebecois grid for assessing integration was 
adapted to the French context. The detailed grid 



modifications were published elsewhere [9,17]. Each 
indicator was attributed a number of points, for a total of 
100 points, yielding the implementation rate (Table 1). 
Close collaboration of French and Quebecois research 
teams made this adaptation possible. Concerning the 
method, we wanted to retain the component-weighting 
used during the Quebecois Programme of Research to 
Integrate Services for the Maintenance of Autonomy 
study and to revise, as needed, the indicators used. 

As in Quebec, the research team assesses the rate 
with qualitative and quantitative data collected every 



Table 1 . Example of the Programme of Research to Integrate Services for the Maintenance of Autonomy method cooperation-item grid as it was 
used during Programme of Research to Integrate Services for the Maintenance of Autonomy-France to assess the extent of method 
implementation. 



Planners' strategic variables 



Functional criteria 



Base unit 



Indicators 



Presence of a consultation 
structure 



Representation of the concerned 
participants 

Continuity of the representation 



Regular participation 



Participants informed of the 
changes of services 



Participants enrolled in shared 
regulation of services continuum 



Does a consultation mechanism 
exist? 



Three points 



Do the members represent all the 
groups of participants concerned by 
the integrated network of services? 

Are all the participants stable 
representatives? 

Do the representatives regularly 
attend the meeting? 

Do the participants share the 
information on changes of the 
targeted services for the elderly, 
within the strategic (planner) 
roundtable and tactical 
(administrator) roundtable 
meetings? 

Do the participants play a role in the 
regulation of the services continuum 



Three points 
Three points 
Three points 
Four points 



Four points 



Breakdown of the base unit: 

One point for its existence (binary grading: yes, 

1; no, 0) 

One point for its frequency (relative grading: 
0.25, 0.5, 0.75 or 1) 

One point for its organisational independence 
(binary grading: yes, 1; no, 0) 

Number of participating groups represented/total 
number of groups concerned (grading by 
percentage) 

Number of referent designations, representing a 
group of participants/total number of groups of 
participants (grading by percentage) 

Representation stability for each group/total 
number of groups of participants (grading by 
percentage) 

Breakdown of the base unit: 
Two points for the grading considering the 
meeting's agenda: respect versus boycott 
(relative grading: 0.25, 0.5, 0.75 or 1) 
Two points for the grading considering the 
discussion content: model implementation tool 
versus general ancillary problems (relative 
grading 0.25, 0.5, 0.75 or 1) 

Shared regulation corresponds to the extent of 
involvement illustrated by the following types of 
decisions (graded by scaled base units): 
One point for model collaboration (participants 
offering activities corresponding to the needs of 
the targeted populations 
Two points for the mobilisation model (participants 
included in the "shared goal" definition, implying 
accountability of the partners) 
Four points for the social development model 
(participants involved in structural and/or 
functional changes, implying power to influence 
the settings, and the participants and their 
commitment to the project) 



20 points 



Note: The final rate is calculated on 100 points: 20 for consultation, 20 for case management, 20 for an integrated entry point, 
15 for the evaluation tool, 15 for the individualized-services plan and 10 for the information system. The reader can find the 
entire grid, its development and theoretical justification in [17]. 
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6 months, with results are reported annually to the sta- 
keholders. The latter identified accompaniment by a 
research team as a success factor, even though none 
spontaneously cited rate assessment as a distinctive 
aspect of this support [12]. 

The French National Alzheimer Plan 
2008-2012: the Home for Autonomy and 
Integration of Alzheimer patients 
experimental phase 

The evaluation grid to assess integration developed for 
the Programme of Research to Integrate Services for 
the Maintenance of Autonomy-France experiment 
underwent two changes during Home for Autonomy 
and Integration of Alzheimer patients. In both cases, 
the goal was to obtain a tool that did not require a 
research protocol to be completed. 

One of the tools developed was aimed at accompany- 
ing the individuals responsible for carrying out the pro- 
ject (the pilots) in their work, enabling them to 
appreciate the degree of integration progression. This 
tool was derived directly from the evaluation grid and 
required massive data collection. It was given to the 
pilots during the institutionalization phase after 2010, 
but its real use had not been followed. 

The other tool was developed to be a very simple way 
to evaluate integration based on the absence or pre- 
sence of 24 criteria (Appendix A). Called the 'MAIA 
24' score, its primary aim is to enable off-site external 
evaluation of the integration level, based on the key 
integration-progression indicators, eventually enabling 
comparisons among territories. Unlike the grid that 
seeks exhaustivity concerning all the key integration 
components, the 'MAIA 24' score focuses on several 
criteria that appear to be the most important and, 
thus, this simple tool has no pedagogical goal (for the 
pilot, stakeholders or deciders) concerning integration. 
Criteria were selected by interdisciplinary researchers 
and managers from health and social fields and by con- 
sensus. Consensus was reached easily through dialo- 
gue, without any particular method (e.g. nominal 
group or Delphi). The 'MAIA 24' criteria were selected 
from among the evaluation-grid items based on these 
characteristics: simplicity, restricted number, objective 
(as opposed to subjective) criteria, and those discriminat- 
ing, as much as possible, criteria among the sites and 
their advances towards integration. Based on the pilots' 
declaration in stage reports, the 17 experimental sites 
were monitored in parallel with this indicator and, more 
profoundly, by the national Steering Committee and two 
public health researchers. After refining the score during 
the second half of the experiment, it was possible to 
'classify' the sites according to their evolution-towards- 



integration status and to adapt the score according to 
the deciders' possible recommendations. Actual tool 
use by these deciders remains unknown because the 
scientific evaluation of implementation was interrupted. 

Results of the National Alzheimer 
Plan experimental phase and 
proposed score 

The rating was done with the 'MAIA 24' grid, with only 
objective data reported by the pilots to the national 
team at implementation onset (June 2009), during the 
preparatory phase of case management (October 
2009) and at 1 year (June 2010). The evolving site pro- 
files are illustrated in Figure 1. Three essential findings 
were drawn from this figure: globally, integration pro- 
gressed at all the sites; rating dispersion tended to 
decline over time, which seems to indicate a trend 
towards homogeneity of the structures put in place 
(and, thus, contribute to the equitable treatment of the 
populations among the sites); and the score seems to 
have reached a marked 'ceiling' effect. 

Using this grading method, five categories, 1-5, were 
identified, with 1 corresponding to the most advanced 
sites and 5 the least advanced. In addition to this grad- 
ing, between April and July 2010, the national experts 
visited all the sites, where they conducted qualitative 
research with extensive on-site interviews with the pilot 
and his employer, observed the process put in place to 
orient 'client' requests for information as a single entry 
point and met all the case managers in focus groups. In 
addition, the experts discussed the on-site situation 
before the visits with the Steering Committee. After 
the on-site visits and taking into consideration all the 
available information, the two experts determined site 
typology, as a function of the status of their Home 
for Autonomy and Integration of Alzheimer patients- 
programme implementation advancement. Five new 

Grade according 
to MAIA 24 score 

24 i 




grade 1 grade 2 grade 3 



Figure 1. Successive ratings of the 17 sites using the described 24-point 
score. The ordinate is the grade accorded with this tool (maximum 24) 
plotted versus the grading period. Each line represents one site's three 
grades during the experimental period. 
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Table 2. Comparison of groups according to their quantitative MAIA- 
24 scores versus qualitative data scores. Scores of 1 correspond to 
the highest level of method implementation, while scores of 5 are the 
lowest. 



MAIA 24 Quantitative score 



Qualitative score 


1 


2 


3 


4 


5 


Total 


Group 1 


2 










2 


Group 2 




2 


2 


1 


1 


6 


Group 3 




1 


1 


1 




3 


Group 4 




2 


2 






4 


Group 5 










2 


2 


Total 


2 


5 


5 


2 


3 


17 



site groups, 1-5, were created, with 1 corresponding to 
the most advancement and 5 to the least. 

Comparison of the grades of the two site-classification 
methods (Table 2) highlighted two principal findings: a 
relationship seemed to exist between the two assess- 
ment methods; and the relationship was not perfect, 
with some sites having high MAIA-24 score integration 
and low expert-accorded scores (objective data favour- 
ing integration but the real situation demonstrating poor 
partnerships), and some sites having the opposite rat- 
ings (objective data indicating low-level integration 
countered by the quantitative evaluation). The exact 
reasons for the discrepancies between the two rating 
methodologies were not completely elucidated. One 
possible explanation is that some pilots were more 
skilled in reporting and communication with regulatory 
authorities, while others had better personal approaches, 
empathy and local networking. A quantitative methodol- 
ogy would have favoured the former and a qualitative 
one the latter. Another possibility is the heterogeneity of 
integrated care among areas. In large experimental 
areas, the integrated-care level was constantly heteroge- 
neous, with some territorial zones having effectively 
working integrated health- and social services, while 
fragmentation persisted in others. Depending on the indi- 
cator and the degree of heterogeneity, this disparity 
could engender over- or underestimation of the real 
integrated-care level. This hypothesis is supported by 
the link between area size and extent of the differences 
between the two assessment methods (data not shown). 

Considering the results obtained during the first period, 
the final score at the end of the experimentation (2008- 
2011) led to a second evaluation (data not given but 
similar to those obtained during the first period, with a 
less marked ceiling effect; Appendix B). 

Why this study was not pursued 

According to our findings, it is clear that the proposed 
simple tool must undergo serious validation and it is 



not yet possible to know whether or not the grid's larger 
pedagogical objective has been met. Experimental 
phase results were judged sufficiently convincing to 
initiate the institutionalization phase. However, the 
newly elected government's budget no longer funded 
research, which was interrupted. 

The tools described herein were proposed on a larger 
scale in France, without any new study on validation 
or current practices planned. We explained elsewhere 
why an idea-to-outcome gap is common in politics 
because of the narrowness of the 'political window' dur- 
ing which any system change is possible [18]. Consider- 
ing that integrated care is somewhat difficult to achieve 
and that 'political discourse' no longer supports the 
Home for Autonomy and Integration of Alzheimer 
patients approach, the new Home for Autonomy and 
Integration of Alzheimer patients tend to be reduced 
to only the implementation of a case-management 
initiative for the elderly in complex-living situations 
and some coordination mechanisms [18,19]. 

Conclusion: lessons drawn from 
the evaluation of the degree of 
implementation; relevance for the 
international community 

Positive lessons from the international 
Programme of Research to Integrate 
Services for the Maintenance of 
Autonomy method implementation 
experiment 

The Programme of Research to Integrate Services for 
the Maintenance of Autonomy-France experiment and 
its institutionalization within the framework of the 
National Alzheimer Plan 2008-2012 constitute highly 
original sources of knowledge. Indeed, because the 
same integration implementation method was applied 
in France and Quebec, it is possible, for the first time, 
to obtain transnational data on integrations and to 
accumulate information on the assessment of the 
extent of integration implementation. All our results 
[8,10-12] underline that the Programme of Research 
to Integrate Services for the Maintenance of Autonomy 
method is an adaptive methodology to move towards 
integrated care in systems as different as France (pre- 
dominantly Bismarkian) and Quebec (predominantly 
Beveridgian) [14]. Our findings also stress the impor- 
tance of political discourse to obtain the expected 
national impact of the policy. Finally, should another 
country decide to adopt and adapt the Programme of 
Research to Integrate Services for the Maintenance of 
Autonomy method to implement integrated care using 
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the previously learned lessons [7,11-13,18], this paper, 
based on an interrupted implementation study, can help 
identify some additional key lessons. 

Positive and caution lessons from 
assessing implementation 

Implementation-level evaluation: 

(1 ) constitutes an important condition supporting the organi- 
zation modifications necessary to establish such an 
institutional, organizational and clinical innovation; 

(2) is possible with the Programme of Research to Integrate 
Services for the Maintenance of Autonomy methodology 
and enables implementation assessment in very different 
national settings, provided that the prerequisite adaptation 
work is done; 

(3) can be useful for two reasons: integration progression and, 
in this indication, its assessment can be simplified (but this 
approach must be repeated to be validated), and the eva- 
luation may have an educational role, making it necessary 
to conserve a sufficiently subtle and, thus, rather extensive 
grid (this educational goal also warrants further work); 

(4) must not be the sole means of assessing real modifica- 
tions engendered by integration implementation, even 
though it allows 'regular' off-site management, as it can- 
not replace more precise evaluation by on-site visits and 
meetings with the different partners involved; and 

(5) must be accompanied by adequate training of the indivi- 
duals responsible for collecting and processing the data 
needed to provide essential information to services stake- 
holders, managers, administrators, policy makers and 
users. 
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Appendix A: The initial MAIA 24 



Cooperation (four points) 



The hospital is represented at the strategy meeting by a 
decider (1) 



A meeting is held to discuss strategy (1) 
If Yes, 

Is a meeting frequency established? (1) 
If Yes 

Decisions are made during the meetings (1) 



No new entry point (for example exclusively dedicated to 
Alzheimer's disease) is created during the period (1) 



Single entry point (six points) 
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An audit is conducted to count the number of responses/entry 
points (1) 
If Yes, 

A road map to consolidate requests for assistance is defined 
among the different entry points (1) 

A scripted decision-tree (according to the individual's needs 
which questions must be asked) is defined and shared 
among the different entry points (1 ) 
If at least one Yes, 

The designation of a single entry point benefits from the 
pooling of resources (1 ) 

The single entry point is accorded an observatory function for 
the needs of the population (1) 

Case management (six points) 

The presence or absence of case managers is determined (1) 
A target population for case management is defined (1) 
If Yes for BOTH, 

The strategy discussion included case management in its 
long-term policy (1) 
If Yes, 

Case load foreseen for case managers <60 (1 ) 
Case-management procedures organize a systematic link 
with patients' general practitioners (GPs) (1) 
Case-management procedures organize a systematic link 
with the hospital physician to assure admission and 
discharge continuity of care (translational care) (1 ) 

Standardized multidimensional 
evaluation tool (three points) 

An evaluation tool is defined and validated during the strategy 
discussion (1) 
If Yes, 

The tool is missing none of the following dimensions: care, 
functional autonomy, social environment, environment, 
psychological-cognitive dimension, financial situation (1) 
If Yes, 

Specific training in the use of the tool is completed (1 ) 

Individualized services plan (three 
points) 

The services plan can only exist once the evaluation tool has 
been validated (1 ) 
If Yes, 

The tool is missing none of the following dimensions: care, 
functional autonomy, social environment, environment, 
psychological-cognitive dimension, financial situation (1) 
If Yes, 

The needs not covered by the plan are mentioned (1) 

Information system (two points) 

No Home for Autonomy and Integration of Alzheimer patients- 
dedicated software tool can be developed without the input of 
the national team (1) 



A specifications document, indicating the information that can 
be exchanged and authorization of access and the network, 
is defined (1) 

The five groups 

If the site had been in the third quartile at the last 
evaluation, it was classed in category 1: sites that had 
implemented a major part of the Home for Autonomy and 
Integration of Alzheimer patients programme according to 
the score. If the site had been in the first quartile at the 
last evaluation, it was assigned to category 5: sites that 
had poorly implemented the Home for Autonomy and 
Integration of Alzheimer patients programme according 
to the score. If the site was previously rated between 
those extremes, the progression between the first and 
last rating was taken into account. If the progression was 
in the third quartile, it was classed in category 2: sites 
with a still moderate implementation score but a strong 
programme-achievement dynamic according to the score. 
If the progression was in the first quartile, it was 
designated category 4: sites with a still moderate imple- 
mentation score and a weak programme-achievement 
dynamic according to the score. If the progression was 
between those two extremes, it was classed in category 
3: sites with a still moderate implementation score and an 
intermediate programme-achievement dynamic according 
to the score. 

Appendix B: The MAIA 25 
score 

This score was adapted to obtain better differentiation of 
implementation progress at the different sites. The tool 
components, individualized services plan and information 
system were deleted because they did not enable the sites 
to be distinguished. The progression of these particular 
components depended more on national politics than local 
decisions. The single entry point was renamed integrated 
entry site, which is more acceptable in the French context. 

Cooperation (10 points) 

(1) Planners' strategy discussions 

A roundtable discussion of strategy took place at least twice 
during the past year (one point) 
If Yes, 

The Regional Health Agency and the General Council 
designated representatives to attend (one point; that the 
point is attributed only if both agencies have a representative) 
If Yes, 

Decisions were made during the meetings (one point; note its 
nature) 

Decisions made during those strategy meetings were 
followed for each structure in the ensuing progress report 
(one point) 
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(2) Administrators' tactical discussion 
The list of invited participants was validated by the strategy 
roundtable. It covers public health and social participants, 
specifies the decision level in the structure and the powers 
of any representative (one point; the point is attributed only 
if all the dimensions are satisfied; if any dimension other 
than 'representativeness' is missing, the point is not 
accorded: no mention of representativeness is interpreted 
as its absence and does not result in a lost point). 

The hospital is represented as tactical cooperation on the 
medical level (head of the medical pole concerned or his 
qualified representative) and the management level (director 
or his qualified representative; one point; the point is 
attributed only if the two representatives are present; for the 
sites associated with several hospitals, the presence of a 
single 'dual representation' suffices to obtain the point but is 
obviously not sufficient with respect to integration). 

All operational case-manager teams (social workers, 
polyvalent and/or geriatric social service, local information 
centre, local information and coordination centre services, 
when appropriate) are represented at the roundtable 
meeting by a representative who is a department head or 
director (one point; it is attributed only if all the partners are 
represented). 

Decisions made during the tactical discussion are 
described in the next progress report (one point). 

Each participating structure is indeed present and appears 
in the decision follow-up (one point). (The focus here is on 
those 'absent' from those meetings. Did those with the 
power to represent them indeed transmit the decisions 
down the line to the structures? This question should be 
monitored by the pilot. In the absence of representation, the 
point is not attributed; indeed, for a decision to be effective, 
the representation procedures seem necessary, for 
example, so that all at home nursing services and hospital 
and temporary lodging services are represented). 

Decisions are made based on information from a shared 
database (one point). (This point could not be attributed 
during the experimental phase because the partners were 
not yet sharing information of the integrated entry point 
-type; at best, these data were collected by the pilot alone). 

Integrated entry site (10 points) 

(1) Tools 

A scripted decision-tree was validated at the strategic and 
tactical meetings (one point) 

The scripted decision-tree is multidimensional (it draws 
attention to the situation in the fields of health, functional 
autonomy, and familial and social, economic, administrative, 
environmental and individual safety needs; one point; it is 
attributed only if all the dimensions are present; if any 
dimension is missing and the point is not accorded). 



A scripted decision-tree foresees orientations towards a 
diversified range of services and is not limited to filtering 
access to care management (one point). 

The reference intervention allows orientation towards all 
territorial resources (one point). 

(2) Organization 

The tactical and strategic roundtable-discussion participants 
agree to share all the tools of the integrated reception site 
(one point). 

The territoriality of the integrated entry site is defined by 
written arguments supporting its relevance and validated by 
the strategy-discussion participants (one point). 

Assignment of same-coded tasks and interventions for the 
national territorial partners is validated at the tactical 
roundtable discussion (one point). 

The tactical and strategic roundtable participants decide on 
a permanent integrated entry site for information and 
orientation shared by the partners (one point; this issue 
concerns rating how partners take one another into account 
to assure the permanent availability of information: switching 
telephone numbers to another line, shared resources or 
personnel and, eventually a single phone number). 

Tactical roundtable-discussion decisions rely on the 
database established via the integrated entry site (one 
point; the difference with the common database is that the 
point is attributed if only the pilot uses these data; making 
these data available to everyone is an additional step). 

The documents issued from strategic meetings of case 
manager and the Regional Health Agency (gerontology 
diagram, organization plan...) take the Home for Autonomy 
and Integration of Alzheimer patients integrated-entry site 
organization into account (one point). 

Case management (five points) 

Case load for each full-time manager is around 40 (one point; 
the point is attributed for the first 2 years if the case load 
reaches or exceeds 30; subsequently, it must exceed 36 but 
be less that 44). 

The case-management procedures organize a systematic 
link with the GP (as attested by the transmission of the 
'case-management procedure' document (one point). 

The case-management procedures organize the place of 
case managers during hospitalizations and the admission 
and discharge continuity of care (idem; one point; idem). 

The mean time between the first application and the case 
manager's first visit is <10 days, and the number of missing 
data for the two dates <10% (one point). 

The tactical roundtable-participants' decisions rely on the 
data in the case manager's or the database activity report 
(one point). 
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